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Thanks to recent technological advances, it is now possible to track with an un- 
precedented precision and for long periods of time the movement patterns of many 
living organisms in their habitat. The increasing amount of data available on single 
trajectories offers the possibility of understanding how animals move and of testing 
basic movement models. Random walks have long represented the main description 
for micro-organisms and have also been useful to understand the foraging behaviour 
of large animals. Nevertheless, most vertebrates, in particular humans and other pri- 
mates, rely on sophisticated cognitive tools such as spatial maps, episodic memory 
and travel cost discounting. These properties call for other modeling approaches 
of mobility patterns. We propose a foraging framework where a learning mobile 
agent uses a combination of memory-based and random steps. We investigate how 
advantageous it is to use memory for exploiting resources in heterogeneous and 
changing environments. An adequate balance of determinism and random explo- 
ration is found to maximize the foraging efficiency and to generate trajectories 
with an intricate spatio-temporal order, where travel routes emerge without multi- 
step planning. Based on this approach, we propose some tools for analysing the 
non-random nature of mobility patterns in general. 

Keywords: mobility patterns, agent based models, memory, foraging 
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1. Introduction 

The literature on the movement of mobile agents has long been dominated by ran- 
dom walk models in which movement decisions are first order Markovian or with 
rapidly decaying correlations: that is, based entirely on conditions that are proxi- 
mate in time and local in space. This approach has been extraordinarily successful in 
describing the behaviour of everything from microscopic particles to simple organ- 
isms such as insects and bacteria (Turchin 1998; Colding et al. 2008). Extensions 
of random walk models beyond Brownian motion, for instance to processes gov- 
erned by steps and/or waiting times with heavy-tailed distributions (Shlesinger & 
Klafter 1986), have also been used to describe the displacements of microzooplank- 
ton (Bartumeus et al. 2003), spider monkeys (Ramos- Fernandez et al. 2004), marine 
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predators (Sims et al. 2008) or even bank notes (Brockmann et al. 2006). Other 
extensions have considered multiple random walks, which are useful to identify the 
presence of different behavioural states in foraging data (Morales et al. 2004) 

However, the Markovian approach has serious limitations and other research 
frameworks are emerging (Nathan et al. 2008; Gautestad & Mysterud 2009). In 
particular, memory storage and processing capabilities allow humans, nonhuman 
primates and other large-brained vertebrates, to transcend the shackles of a first 
order Markov world. Many animals escape the present using episodic memory, the 
ability not just to associate past events with a particular time and place but project 
how conditions at that place may have evolved since that event (Grifhths et al. 1999; 
Dere et al. 2008; Rolls 2008). In fact, animals can even use episodic memories of 
past states to predict future states (Martin-Ordas et al. 2010), a good example 
being the ability of mangabeys to predict how weather has affected the ripening of 
fruit (Janmaat et al. 2006o, h). Animals escape their current location with spatial 
representations such as cognitive maps (Wills et al. 2010), Euclidean representa- 
tions of space which allow them not only to navigate directly to important habitat 
features (e.g. resource patches) that are outside of the perceptual range (Normand 
& Boesch 2009; Prcsotto & Izar 2010), but also a priori estimate the cost of travel- 
ing there (Lanner 1996; Janson 2007; Janson & Byrne 2007; Noser & Byrne 2007). 
These advanced cognitive capacities mean movements need not be governed en- 
tirely by random decisions based on proximate states but may also be informed by 
deterministic cost-benefit analysis that compare the predicted benefits for differ- 
ent movement choices with their estimated costs (Walton & Mars 2007; Hillman & 
Bilkey 2010). Models motivated by observations on spider monkeys (Boyer et al. 
2006), ungulates (Getz & Saltz 2008) or humans (Lee et al. 2009) have explored 
how such decisions can induce complex movement patterns in heterogeneous envi- 
ronments. 

In the realm of Markovian processes, a lot of attention has been devoted in the 
past decade to identify efficient search strategies for finding prey or food patches 
whose locations arc unknown to the forager (Viswanathan et al. 1999; Benichou 
et al. 2005; Viswanathan et al. 2008; Oshanin et al. 2009). The impressive set of 
cognitive tools mentioned above offers the promise of more efficient foraging. Never- 
theless, efficiently exploiting resources still presents some daimting challenges. Even 
with perfect information about the size and location of resource patches, the compu- 
tational load entailed in choosing the most efficient route through a series of patches 
rises exponentially with the number of patches, quickly becoming intractable (the 
classic Traveling Salesman Problem). What's more, in the real world information 
is rarely perfect. Resources are often ephemeral and unpredictable because of the 
irregularity of environmental forcing, resource production dynamics, and harvest- 
ing rates. Consequently, the accuracy of predictions about resource quality tends to 
decay with time since the last visit to a given location. Because for mobile agents 
time tends to correlate with displacement, prediction accuracy tends to be greatest 
within some limited spatial neighborhood of the agent's current location. This sug- 
gests that the best vertebrate foragers can hope for may be a combination strategy 
akin to that employed in search algorithms such as Markov Chain Monte Carlo 
simulations, with deterministic memory-based movements used to move the forager 
up local maxima in the rugged foraging efficiency landscape and occasional random 
steps used to explore the constantly evolving landscape for higher maxima. 
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Here we use a simulation model of monkeys foraging on fruit trees to explore 
how spatial and temporal heterogeneity in resource distribution constrain how ad- 
vantageous it is to have a big brain. More specifically, an adequate balance between 
deterministic, memory-based movement and random exploration is found to max- 
imize the forager's efficiency. Therefore, some degree of stochastic search is still 
advantageous for foragers with high cognitive skills and foraging in not-so-scarce 
environments. We examine how the distribution of fruit tree sizes and the duration 
of fruiting infiuence this optimal balance. We show that the concepts of efficiency 
and order are intricately related in this system: optimal strategies produce the 
trajectories that have the highest degree of spatio-temporal order. Our simulation 
model assumes that monkeys have a set of fairly sophisticated skills, including 
cognitive maps, episodic memory, and travel cost discounting. Although there is 
mounting empirical evidence that monkeys and other vertebrates have these skills 
(Janson & Byrne 2007), our conclusions do not require them. Rather, they are also 
valid for a much broader class of models in which the hill-climbing advantages of 
memory are traded off against the exploratory value of random movement (see, e.g., 
Tabone et al. 2010 in the context of ant foraging). 

2. Model 

Medium. We consider a square lattice oi N x N sites with lattice spacing a, where 
a random fraction p of the sites is occupied by resource patches (fruit trees). A 
site contains 1 or resource patch. The medium is also heterogeneous in the sense 
that the resource patches are not of equal value. A tree located at site i has a size 
ki representing the total amount of fruits it can produce each year. The tree size 
probability distribution function is given by 

f{k) = Ck ^ , k„iin 1^ k kmaxi (2-1) 

with k a continuous variable, /3 > 1 an exponent and {kmimkmax) two constants. 
The form (|2.ip is justified by empirical observations showing power-law distributions 
for tree sizes in tropical and temperate forests (Enquist & Niklas 2001; Niklas et 
al. 2003). For low values of /? (typically, in the range [2,4]), a few sites concentrate 
an important quantity of resources, whereas for larger values of /? the medium is 
homogeneous and composed of trees with similar sizes. 

Each tree produces fruit once a year during a fruiting period of rifiuit consecutive 
days. nfiuit(= 30 days in the following, unless otherwise indicated) is assumed to 
be the same for all trees. However, not all trees start fruiting at the same time. 
Rather, start dates are randomly and uniformly distributed throughout the year, 
see Figure[T^. Let us denote fruiti{t) as the amount of ripe fruit on tree i at time t. 
During its fruiting period, i produces fci/ntmit new ripe fruits per day {i.e., ki fruits 
during the whole period). For simplicity, the quantity /Ei/ntmit becomes available 
( "ripens" ) at the beginning of each simulation day. Ripe fruits remain available for 
a period of rirot days after which they rot (become unavailable for consumption) . 

Forager movement rules. A mobile agent foraging in this medium is either 
immobile eating on a fruiting lattice site with a constant feeding rate r (eaten 
fruits/min) or moving at constant velocity vq (lattice spacings/min). The elemen- 
tary simulation time step is Ai (= 0.5 min in the following). The agent switches 
its activity from eating to moving when no ripe fruit is left in a tree, and switches 
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Figure 1. (Color online) Resource patches, e.g. fruit trees, are randomly distributed on a 
square lattice with density p. a) Each tree produces fruit during a fruiting period (bright 
green) of duration rifmit days and is unproductive the rest of the year (dark green). The 
date when a given tree starts fruiting is the same every year, and is randomly and uniformly 
distributed in the interval [0, 1 year], b) A forager located at tree i may take a step 
towards a tree visited in the past (denoted with K, as in "known" tree) or a random 
step, with probabilities 1 — p and p, respectively. The probability p involves a parameter 
r), see Eq. (|2.5P . that varies movement between entirely random (ry — > oo) and entirely 
deterministic (77 ^ 0). 



from moving to eating when the trajectory crosses a site with ripe fruits. The agent 
moves in a continuous way along linear steps joining pairs of lattice sites, and can 
not exit the N x N domain. At the end of a step or after a feeding event, the forager 
takes a new step. 

Before describing the movement rules, let us note that the agent has cognitive 
skills that enable it to remember the locations, sizes and fruiting states of previously 
visited trees. Hence, during the course of ranging, the agent adds to a list of known 
trees (marked as "K" in Figure [T]d) any tree which is visited for the first time: the 
agent records the tree's location, size ki, fruiting state (fruiting or not), and ripe 
fruit crop size. We assume that once a tree's size and location are known, they are 
not forgotten. When a known tree is revisited, the agent updates its memory about 
the tree's fruiting state (for instance, from "non-fruiting" to "fruiting") and fruit 
crop size. We assume that each forager has a model of the fruit ripening process 
that allows it to correctly estimate how much ripe fruit should now be in a known 
fruiting tree j, fruitj{t). When a tree known by the agent to be "fruiting" actually 
ends its fruiting period, the forager also changes the tree's state to "non-fruiting" 
in its memory. However, foragers can only predict the fruiting state of trees visited 
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during their most recent fruiting period. They cannot remember when the fruiting 
periods of trees are and, therefore, cannot anticipate fruiting states from one year 
to another. 

At each movement step, the forager may or may not decide to visit a known tree. 
It either heads towards a known tree j* (with probabihty 1 —p) or takes a random 
walk step (with probabihty p), see Figure [T)d. Hence, despite of its knowledge, the 
forager may decide to take a random walk step, which is drawn from a step length 
distribution function, /rnd(Oj where I > a. In a deterministic step, the forager 
chooses as a target the known tree that is most efhcient: i.e. that provides the 
best tradeoff between ripe fruit crop size and travel distance. For this purpose, we 
introduce an one-step efficiency function, ei{t), given by: 

e,{t) = maxj- [Fj {t)/d,j] = Fj, {t)/d,j, , (2.2) 

where the index j runs over the list of all known trees and dij is the distance 
between forager location i and tree j. The quantity Fj is the estimated amount of 
ripe fruit in tree j and, if the tree is known as "fruiting" , is given by 

Fj{t)^ fruit,{t), (2.3) 

If the tree is known as "non- fruiting" then Fj [t) = if the tree has already been 
visited during the current day; otherwise, 

F,{t) = {frmt,{t)), (2.4) 

the average being taken over an entire year. In Ea. (j2.4p . a tree known as "non- 
fruiting" can still be considered as a potential destination as the tree may have 
started fruiting since the latest visit. Nevertheless, it tends to be less attractive 
than a known "fruiting" tree of same size and at the same distance, as {fruit j{t)) 
tends to be lower than the typical amount of fruit that j carries during its fruiting 
period. The rule (j2.2p simply indicates that the closer and the larger a known 
tree is, the more efficient would be a step toward that tree. The particular tree 
that maximizes Eq. (|2.2p . or the 'best' known tree, is j*. Note that a fruiting tree 
recently depleted by the forager has Fj (t) — and thus will not be considered until 
it produces new fruits, the next day. 

As explained above, the agent takes a step towards j* with probability 1 — p, 
where p is given by: 

p = exp(-e,(i)/?7), (2.5) 

with r] a constant. The rule (|2.5p indicates that the forager is more likely to visit j* 
if it is a "good" tree (large e^, low p). In turn, if the known trees are far away from 
the current location of the forager and/or of small sizes, the forager will prefer to 
take a random step instead {p 1). Therefore, the parameter 77 does not control 
the memory capacities of the forager (which arc assumed to be perfect), but the use 
of memory by the forager: known trees with 3> 77 will tend to be visited, while 
those with ^ 77 will be ignored. The limit 

77 ^ 00 (2.6) 

produces random walk trajectories, whereas 

7? 0, (2.7) 



Article submitted to Royal Society 



6 



D. Boyer and P.D. Walsh 



corresponds to a forager with movements that are entirely determined by the mem- 
ory, tending asymptotically to revisit the same fruit tree. With this set of rules, if 
all known trees have been visited during a single day {i.e. in a time shorter than 
the refreshing period), then p = 1. At i = the forager is placed with no previ- 
ous knowledge of the medium and p is obviously 1. Each time an unknown tree is 
encountered (during a random walk step or en route towards a known tree), it is 
added to the list of known trees, which grows as time proceeds. 

Below, we will investigate the effects of varying three parameters of the model: 
■q (the tendency to take random steps), /3 (the fruit crop size distribution) and 
«fruit (the duration of each tree fruiting period). The eating rate (r), displacement 
speed (wo) and (fcmin, kmax) are fixed to realistic values so that the forager visits a 
number of trees much larger than 1 on average during one day (the period of fruit 
refreshing) . The forager often feeds no more than a few minutes on a tree but may 
occasionally spend a few hours on a very big fruiting tree, which is consistent with 
observations on spider monkeys, for instance (Ramos- Fernandez et al. 2004). 



We start by computing the foraging efficiency of the mobile agent, defined as: 



where /C is the total amount of fruits eaten and C the total distance traveled by 
the forager. An alternate definition is E = {IC)/t with t the foraging time, leading 
to similar results to those presented below. The average in Ea. (j3.1[) . which tends 
to a stationary value after a few years, is taken over different realizations of the 
media and foraging trajectories. Figure [5^ displays £' as a function of the memory 
parameter rj, for different tree size exponents /3. For easier comparison, kmm is 
adjusted so that the total amount of resources produced in one year in the domain, 
{k)N'^, remains the same even though the tree size distribution varies. 

The foraging efficiency exhibits a maximum at an intermediate level of mem- 
ory use, ?7opt. Somewhat surprisingly, the deterministic, memory-based steps (j2.2p . 
which at small rj are increasingly common relative to random choices do not nec- 
essarily have a positive impact on the long term efficiency. This property can be 
qualitatively understood by noticing that, given the dynamical rules of Section [51 
random steps are often taken at the beginning of a run because of limited knowl- 
edge. When the number of known trees becomes large enough, a forager with very 
small 77 can forage exclusively on known trees between two fruit production events 
{i.e. a one day interval). Hence, a forager with 77—7-0 will tend to revisit the same 
set of learned tree locations, reducing the exploration of other areas where other 
fruiting trees could be encountered. To the contrary, a random forager (77 large) 
visits a larger number of different trees but does not use its knowledge to improve 
efficiency by moving directly to large and/or nearby trees. Note that no fine tuning 
of the one-step cross-over efficiency 77 that controls the use of random search relative 
to memory is necessary to bring the forager in the efficient region: the long term 
forager's efficiency varies with log r/ rather than with 77. 



3. Results 



(a) Foraging efficiency 




(3.1) 
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Figure 2. a) Foraging efficiency in media with different levels of fruit crop size heterogeneity 
{P = 1.5, 2, 3, 4). The other parameters are a = 1, At ^ 0.5 min., iV x iV = 4 lO", p = 0.75, 
(k) = 19.9, kmax ~ 2000, n fruit = 30 days, Wrot ~ 7 days, r — 0.2 eaten fruits/min, vq = 2a 
min^^, /rnd(0 °^ l-~" with q — 2.5 (the curves are little affected by other choices of /md)- 
b) Same quantity for P — 3 and two different fruiting durations, ntmit = 30 days and 120 
days. 



A mixed strategy is the most efficient in this context, specially if resource patches 
have heterogeneous sizes (small /3). Whereas the foraging success of random and 
deterministic foragers is rather independent of the tree-size distribution, efficiency 
increases with medium heterogeneity in the range of intermediate strategies (Fig. 
[5^). In other words, the optimal strategy becomes increasingly advantageous with 
respect to others when fruits are unevenly distributed in space. In general, the selec- 
tion of the best tree j* is biased towards large tree sizes: i.e. thanks to rule (|2.2p . the 
forager selects preferentially a subset of trees with larger sizes than those given by 
a random sampling of the distribution (|2.ip . When /? decreases, this effect becomes 
more noticeable. As previously shown analytically on a very simple foraging model 
(Boyer & Larralde 2005), the single-step efficiency (j2.2p of a forager knowing many 
trees tends to be higher when heterogeneity increases: on average, Fj* increases 
faster than the travel cost to j* . This explanation does not hold, however, at low 
values of ry in the present model, when the number of places susceptible of being 
visited is reduced by the lack of previous random exploration. 

Another significant aspect that favors the use of a mixed foraging strategy is 
the fruiting duration rifiuit of a tree. When nfruit ^ 365, the medium is unpre- 
dictable to the forager: at a given time only a small fraction of the trees are fruiting 
(«fruit/365 = 0.082, in Figl^^), and they fruit for a relatively short period of time. 
To show that behaviours exclusively based on memory (j] ~ 0) are not adapted 
to rapidly changing environments, we have varied nfruit- As shown by Figl^b, the 
use of the optimal strategy brings a greater relative advantage compared to more 
deterministic strategies when ntruit is small. Nevertheless, for 77 > jyopt, i-e- for be- 
haviours more random than at optimality, the relative efficiency is not affected by 
the tree fruiting duration. 

In the following sections, we investigate connections between the foraging effi- 
ciency and the spatio-temporal structure of the walks. 
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(6) Spatial order of occupation patterns 



Processes involving memory are a priori more predictable than random walks. 
Predictability has been addressed empirically in the context of human displace- 
ments by means of entropy measures (Song et al. 2010). Assume that the forager is 
optimal because it better "knows" , at any time, where the most profitable resource 
sites in the disordered environment currently are and how to exploit them. Do the 
corresponding walks have an ordered spatio-temporal structure that would make it 
easier for an external observer unaware of the movement rules to predict the forager 
position? Among the possible quantities related to the degree of predictability of a 
trajectory, we will consider two entropies: the average occupation entropy, 



where pi is the probability of finding the forager on site i during a time window of 
duration T (the average being taken over successive time windows) ; and the average 
visitation entropy. 



where Vi is the number of visits that site i has received during a time window of 
duration T, normalized to unity Vi = I). Contrary to S, does not take into 
account the time spent on i, but the number of steps that arrived at i. Figure [3] 
display E, S and as functions of rj, for media of varying heterogeneity. We set 
T = nfruit(= 30 days) as other choices give similar results. 

Sv has lower values when rj is low, meaning that the visits among sites are 
unequally distributed. As new fruit are produced each day, the same fruiting trees 
can be revisited after being depleted. The biased choice toward larger trees also 
amplify uneven visits: evident in the fact that decreases as /? decreases, i.e., when 
the probability of finding large trees in the system increases. In a given medium, 
after a plateau (in the cases /? = 2 and 6), the visitation entropy increases with 
?7, as more frequent random steps even out the number of visits received by the 
different trees. 

The behaviour of S is quite different as it is not minimum at ?/ = but at an 
intermediate value close to rjopt- In the case /3 = 3, the location of the minimum 
is actually indistinguishable from the maximum for the efficiency. Low values of S 
can be related to uneven visits and/or uneven occupation times (hence, S < Sy). 
The time spent at a tree is determined by its ripe fruit content. Given the power- 
law distribution of the tree sizes, one may a priori expect very unequal feeding 
times in media with small /3, thus lowering the entropy. In a given medium, the 
curves of S show that this effect is maximal in the vicinity of the optimal strategy, 
when many of the trees visited in a given foraging time are currently fruiting. For 
V < ??opt, however, the higher entropy indicates that residence times are more even: 
as confirmed by measures of C and K. (not shown), the forager spends more time 
traveling and less time feeding. In this case, the fruiting trees are more rapidly 
depleted and non- fruiting trees are more often chosen as target sites, from rule 12.41 
If a visited tree is not fruiting, the forager stays for a short time at the site, no 




(3.2) 
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Figure 3. Foraging efficiency {E), occupation entropy (5), visitation entropy (Sv) and 
mean route length (Ir) as a function of tlie parameter for memory use (r;), for liigfily 
lieterogeneous (/3 — 2), moderately heterogeneous (/3 — 3) and homogeneous (/3 2> 1) 
landscapes. 



matter the tree size. Similar patterns are observed at large rj: in this situation, this 
is because trees are visited more randomly and most of the trees are non-fruiting. 

In homogeneous media (/3 = 6, Figure [21), visitation and occupation patterns 
become more similar. The minimum in S disappears and is replaced by a flat 
plateau: S becomes remarkably constant for 77 < 7?opt- 

(c) Travel routes 

The above entropy measures capture the spatial heterogeneity of the occupation 
and visitation patterns but not their temporal correlations. To gain some insight 
into the time regularity with which some sites are visited, we now look for repeated 
sequences in the trajectories. 

As in the previous section, we decompose a whole trajectory in time windows 
of duration T{= rifruit days in the following). We then convert the continuous 
forager positions within a same time window into a series of visited lattice sites 
{ii,Z2, ...,in}- As we focus here on the paths followed by the forager, we do not 
count the amount of time spent at each site (therefore, two consecutive sites are 
necessarily different). In the series of visited sites, we denote a fc- route as a se- 
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Figure 4. One-month trajectories in a homogeneous landscape, above and at optimality 
(same scale). The dark thick lines indicate the routes defined as subsequences of A; = 6 or 
more consecutive sites that appear more than once in the trajectory (see text for details). 

quence of at least k consecutive sites which appears more than once. For practical 
purposes, two sequences that are locally distant of no more than one lattice spacing 
a are considered to be part of the same route. With p = 0.75 and rifiuit = 30 (the 
values chosen for Fig. [3]), the mean separation distance between two neighboring 
fruiting trees is 6a. As a route is likely to join two fruiting trees, we choose fc = 6 
as the minimal sequence length. 

In media with homogeneous tree sizes and for the range of values of rj considered 
in Figure [3l the 6-routes represent about 30% (higher 77) to 90% (lower ry) of a 
trajectory in a given time window T. Figure 3] shows two trajectories with their 
routes highlighted. In this example, at optimality, about 52% of the sites of a 
trajectory are located on the routes, the mean number of routes is 57 and each 
route is used 3.3 times on average by the forager. With decreasing randomness, the 
number of routes slightly decreases but each route is used much more frequently. 

We denote the average length of a route as Z,-. This quantity is analogous to a 
correlation length and indicates the persistence of the forager when it is engaged 
in a route. In other words, it measures the predictability of the forager movements 
when it starts repeating previous positions in the same order. As shown in Figure 
[3l this quantity reaches a maximum in the vicinity of ?7opt, or at the minimum of 
the occupation entropy 5". Other choices of k slightly change the values obtained 
for Ir but not the existence of the maximum near yyopt . 

These results suggest that the optimal forager uses the routes as well as its 
persistence along the routes to revisit several fruiting trees consecutively (a number 
of the order of Ir/Q +1 — 3 to 4). Nevertheless, the complexity of the optimal 
trajectories is probably not fully described by observing a single object. At 77 = »7opt, 
the spatial structure of the routes, which is not captured by Ir alone, reveals a 
relatively regular, interconnected network (Fig. 2]). In this case, the trajectory is 
never very far from a route. By contrast, for rj ^ ryopt the spatial distribution of the 
routes is less uniform, some routes become isolated whereas others are clumped. 
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4. Discussion and conclusion 

Wc have shown that trading off between random and memory-based decisions can 
be advantageous for a forager searching for food. A mixed strategy is specially 
rewarding if the resources are hetcrogcneously distributed in space and their pro- 
duction period is short. Memory is in general useful, as it allows the forager to 
revisit resource patches without searching. But excessive memory use over stochas- 
tic decisions prevents the forager from updating its knowledge in rapidly changing 
environments. 

Ideally, optimizing foraging efficiency in our model medium requires combined 
activities: 1) to deplete nearby or large known trees, 2) to stay in the vicinity of 
known areas in order to revisit at low travel costs the depleted trees once they 
have refreshed, 3) to continuously search for new fruiting trees that will replace 
the known ones when these stop fruiting. Finding the rules that reach the absolute 
maximum efficiency is a task prohibitively complex. Nevertheless, an animal that 
uses a one-step optimization procedure such as the one considered here (instead 
of many-steps planning, for instance) in combination with random steps can in- 
crease its efficiency by a factor of about 3 to 7 compared with the uncombined 
behaviours. This efficiency gain is quite high. In purely random search problems 
with memoryless agents, optimal strategies (obtained, for instance, by tuning the 
Levy exponent of a step length distribution) typically increase the efficiency by 
30 — 40% in scarce environments (Viswanathan et al. 1999). Notwithstanding, our 
results suggest that stochastic decisions are still playing a crucial role for organisms 
with extremely high cognitive skills and foraging in not-so-scarce environments. 
These findings open other perspectives in the debate on the relevance of random 
searches in Biology (Bartumeus & Catalan 2009; Smouse et al. 2010). 

Memory leads to unexpected emergent patterns of habitat use, many of which 
still need to be studied. As shown by a recent multiple random walk approach, 
revisits are not independent events when memory effects are at play (Gautestad & 
Mysterud 2009). In our model, high efficiencies coincide with movements of higher 
predictability, or order. We find that order is enhanced in environments with broad 
tree size distributions, where a few patches concentrate many resources. Low val- 
ues are found for an entropy based on time-averaged spatial occupation patterns. 
Trajectories also become more predictable from a dynamical point of view, with 
longer repeated sequences of visited sites. Similar measures have revealed the reg- 
ular nature of human displacements (Song et al. 2010) and their application to 
real ecological data could be useful to unveil how animals exploit resources. In this 
context, predictability also has implications on the risk of predation: if one asso- 
ciates low forager's entropy levels with higher predation risks, a deviation from 
optimal foraging may decreases that risk. This may be achieved by increasing the 
randomness of the displacements, for instance. 

At optimality, the model forager spends about half of its traveling time revisiting 
previous places in an orderly way, an activity which is reminiscent of the travel 
routes used by real animals (Noser & Byrne 2007). In fact, observation that monkeys 
persistently visit the same sequence of trees has been used to argue that monkeys 
navigate by choosing from a limited set of multi-step routes rather than Euclidean 
cognitive map calculations (Di Fiore & Suarez 2007). What our simulations show 
is that persistent use of the same sequence of trees need not imply the use of a pre- 
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ordained, multi-step route. Rather, what looks like a multi-step route can emerge 
spontaneously from a one step optimization algorithm. In areas that are well-known, 
the forager's cognitive map of the size and location of trees is essentially the same at 
every visit. As the forager tends to make the same sequence of decisions each time 
it visits an area, its episodic memory of local fruiting states is also similar between 
visits. This might occur if depletion dynamics resulted in a characteristic return 
time such that trees tended to be at the same state of refresh at each visit. Or 
characteristic return time might be so long that fruiting states were poorly known. 
In both cases the predicted value for each tree would be proportional to its size 
and the relative values of alternative choices at each step of the chain would be 
consistent between visits. 

Directional persistence is another observation often interpreted to support multi- 
step route planning over the use of one step, Euclidean cognitive map navigation. 
Here, model foragers also tended to show a high level of directional persistence, 
continuing on in the same direction after feeding on a tree. Directional persistence 
occurred in our simulations because a forager en route to a high yield large tree 
often passed close enough to a smaller tree to make a short detour cost effective 
(Janson 2007). 

These examples raise a much broader issue in the study of animal movement. 
Many previous empirical studies have attempted to test alternative models of ani- 
mal navigation in terms of relatively simple, intuitive predictions such as "follows 
route or not" or "takes direct path or not" . What the example above illustrates is 
not just that alternative models often make the same prediction (Janson & Byrne 
2007), but that the fact that a given alternative model predicts a particular move- 
ment pattern is not always intuitively obvious. That a one step optimization al- 
gorithm can cause repeated or directionally persistent sequences of movement is 
not a foregone conclusion that flows necessarily from the algorithm's assumption. 
It is an emergent consequence of the algorithm's application in a heterogeneous 
environment. 

More importantly, just as alternative models can non-intuitively predict the 
same emergent patterns, alternative models can also predict very different emergent 
patterns that often cannot be anticipated from the decision algorithms themselves. 
These emergent patterns represent a huge and virtually untapped body of data for 
discriminating between animal navigation mechanisms and motivations. However, 
what emergent patterns that are predicted by complex navigation models such as 
the one we describe can only be evaluated through simulation. This necessitates a 
shift in statistical inference towards methods such as Approximate Bayesian Com- 
putation (ABC), which allows the fitting of arbitrarily complex simulation models 
to real field data (Beaumont et al. 2002). What makes ABC particularly attractive 
for inference on movement models is the fact that it can use observations not just on 
the turning angle or velocity of particular path segments, but on multiple ensemble 
properties of movement such as the mean, variance or autocorrelation of angles or 
velocities and their cross correlation with environmental features. We expect ABC 
and similar methods to play pivotal roles in shifting the axis of research on animal 
movement from theory and experiment towards field observation. 

This work was conducted as a part of the "Efficient Wildlife Disease Control: From 
Social Network Self-organization to Optimal Vaccination" Working Group supported by 
the National Center for Ecological Analysis and Synthesis, a Center funded by NSF (Grant 
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#DEB-0553768), the University of California, Santa Barbara, and the State of Cahfornia. 
We thank the group members, J. Benavides, D. Caillaud, M. C. Crofoot, W. M. Getz, K. 
Hampton, L. A. Meyers, S. J. Ryan, L. Salvador and S. V. Scarpino for discussions and 
collaborations on this subject. 
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